
DIGITAL CAMERA WITH A MUSIC PLAYBACK FUNCTION 

This patent application claims priority from a Japanese 
5 patent application No. 2000-160036 filed on May 30, 2000, the 
contents of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

10 1. Field of the Invention 

The present invention relates to a digital camera. More 
particularly, the present invention relates to a digital camera 
capable of playing back both music and images . 

Is 

ill 

iTi 2 . Description of the Related Art 

:|L;15 As digital cameras have become widely used in modern times, 

!H functions of digital cameras have correspondingly improved. As 
one of various functions of digital cameras , the function of record 
|" 5 1 and playback music is proposed. 

^ If a digital camera sequentially plays back several images, 

20 the digital camera may provide a slide show of the images . Moreover, 
if the digital camera also plays back music along with the images, 
the digital camera may provide a more attractive slide show in 
the effect of the acoustics provided by the music playback. One 
example is toplay backmusic as background music while sequentially 
25 playing back scenery pictures. 

However, ordinal digital cameras cannot simultaneously play 
back music, which is separately prepared, along with the playback 
of images. Even if a digital camera could play back music as 
background music along with the playback of pictures that a user 
30 wants to see, the time needed for playing back pictures selected 
by the user and the time needed for playing back music selected 
by the user are usually different. If the time for playing back 
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pictures is longer than that of music, the playback of music ends 
first and only the pictures are continually played back. On the 
other hand, if the time for playing back music is longer than that 
of pictures, only the music is played back without the pictures 
5 being played back . Therefore, a user cannot get expected acoustic 
effects by merely selecting pictures and music. 

SUMMARY OF THE INVENTION 

Therefore , it is anobj ect of the present invention to provide 
a digital camera with a music playback function, which is capable 
10 of overcoming the above drawbacks accompanying the conventional 
13 art . The above and other objects can be achieved by combinations 
jg described in the independent claims. The dependent claims define 
:L: further advantageous and exemplary combinations of the present 

f j : 

IH invention. 

3 ~~ 

in 15 

According to the first aspect of the present invention, a 

O 

|F1 digital camera, which includes: an image playback module; and a 

! si 

m music playback module, wherein a plurality of images are played 
13 back accompanied by music , an image playback time for the plurality 
20 of images substantially coincides with a music playback time for 
the music, and the image playback time is defined based on a number 
of the images and a playback time for each of the images, when 
sequentially playing back the plurality of images. 

25 The digital camera may further include: an image setting 

section for selecting the images; and a music setting section for 
selecting the music, wherein an image playback time is adjusted 
to make the image playback time and the music playback time 
substantially coincide, based on the number of the images and the 

30 music playback time of the music. 

The digital camera may further include: an image playback 



FF-0159 



T 



time-setting section for setting the playback time of each of the 
images; and a music setting section for selecting the music , wherein 
the number of the images may be adjusted to make the image playback 
time and the music playback time substantially coincide, based 
5 on the playback time of each of the images and the music playback 
time of the music. 

The digital camera may further include: an image setting 
section for setting the number of the images; and an image playback 
10 time- setting section for setting the playback time of each of the 
images, wherein the music, which is adjusted so that the image 
playback time and the music playback time substantially coincide, 
% g ■ may be edited, based on the number of the images and the playback 
j*j time of each of the images. 

m is 

m 

ig The digital camera may further include an adjustment section 

'** for adjusting the image playback time to substantially coincide 

i 

p with the music playback time, when the image playback time and 

if! 

jjj the music playback time are not substantially the same. 

P 20 

P 

iJ. The adjustment section may include an image playback 

time -adjusting section for adjusting the image playback time; the 
image playback time-adjusting section includes: an image 
number- adjusting section for setting the number of the images ; 
25 and an image time-adjusting section for setting the playback time 
of each of the images, wherein the image playback time -adjusting 
section may adjust the image playback time to substantially 
coincide with the music playback time, based on the image 
number-adjusting section and the image time -adjusting section. 

30 

The adjustment section may include a music playback 
time -adjusting section for adjusting the music playback time; and 
the music playback time-adjusting section may adjust the music 
playback time to substantially coincide with the image playback 
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time 



The digital camera may further include: a playback time 
setting section for setting a time defined by a user as playback 
time of the images; an image playback time -adjusting section for 
adjusting the image playback time to substantially coincide with 
the playback time defined by the user; and a music playback 
time-adjusting section for adjusting the music playback time to 
substantially coincide with the playback time defined by the user . 

An image file may be created having the music playback time 
and the image playback time that substantially coincide. 



■if The digital camera may further include: a movie playback 

111 

jp 15 module, wherein movies may be played back having movie playback 

in 

time that substantially coincides with the music playback time 
! ^ of the music, the music being separate from the movies and played 

Q back to accompany the movies . 

13 20 The digital camera may further include a screen 

l2 switching- setting section for setting the playback time of each 

of the images by synchronizing timing for switching images with 

a specific timing of the music. 

25 The specific timing of the music my be at least one of a 

beginning of each sub- section of the music and a distinctive sound. 

The digital camera may further include an image processing 
section for setting a process of image switching for each genre 
30 of the music. 



The digital camera may further include: a movie playback 
module, wherein movies and the images may be played back such that 
a total playback time for playing back the plurality of images 
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along with the movies substantially coincides with the music 
playback time, and the music may be separate from the movies and 
may be played back to accompany the movies and the images . 

5 Creation information of at least one of the images and the 

movies may be outputted to a file. 

According to the second aspect of the present invention, 
a method for adjusting an image playback time of a plurality of 
10 images and a music playback time of accompanying music to 

substantially coincide, the method which includes: (a) accepting 
<Ba input of instructions for selecting images and music to be played 

*Q back; (b) setting at least one of images to be played back, an image 

^ playback time for playing back the images, music to be played back, 

|H 15 movies to be played back, a total playback time, a music genre, 

In 

ig a screen switching method, and a mixing level; (c) obtaining at 

Ui least one of the image playback time and the music playback time 

□ from the setting of the images and the setting of the music; 

jj (d) adjusting at least one of the obtained image playback time and 

*~ 20 the obtained music playback time; and (e) processing at least 
one of the images and the music after the adjusting of at least 
one of the obtained image playback time and the obtained music 
playback time. 

25 According to the third aspect of the present invention, an 

image and music playback apparatus for playing back images 
accompanied by music, which includes: an image playback module; 
a music playback module; and an images editing section connected 
to the image playback module and the music playback module, the 

30 images editing section correlating an image playback time, which 
is a time for playing back images, and a music playback time, which 
is a time for playing back accompanying music. 

The images editing section may include : an adjustment section 
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having at least one of: an image number -adjusting section for 
adjusting a number of images to be played back; and an image 
time -adjusting section for adjusting a time for playing back an 
image . 

5 

The image and music playback apparatus may further include: 
an image processing section connected to the adjustment section, 
the image processing section processing the images in concert with 
the music to be played back ; and a music processing section connected 
10 to the adjustment section, the music processing section processing 
the music in concert with the images to be played back. 

a 

%U The summary of the invention does not necessarily describe 

i« all necessary features of the present invention. The present 

s i * 

Ifj 15 invention may also be a sub-combination of the features described 

m above . The above and other features and advantages of the present 

ul invention will become more apparent from the following description 

p of the embodiments taken in conjunction with the accompanying 

III 

drawings . 

!3 20 

U BRIEF DESCRIPTION OF THE DRAWINGS 

Fig . 1 illustrates a diagram showing the exterior of a digital 
camera according to an embodiment of the present invention. 

Fig. 2 is a structural diagram of the digital camera 10 
25 according to an embodiment of the present invention. 

Fig. 3 is a diagram showing a relationship between an image 
playback time and a music playback time for playing back 
backup - tuned image s . 

Fig. 4 is a diagram showing a relationship between a movie 
30 playback time and a music playback time for playing back 
backup-tuned movies. 

Fig. 5 is a diagram showing a relationship between an image 
and movie playback time and a music playback time for playing back 
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backup- tuned mixed images of both still and moving pictures. 

Fig. 6 is a diagram showing an exemplary manner of mixing 
voice data and background music for playing back backup- tuned mixed 
images of both still and moving pictures. 
5 Fig. 7 is a structural diagram of a backup- tuned images 

editing section. 

Fig. 8 illustrates an exemplary diagram showing a switching 
manner of images synchronized with sub-sections. 

Fig. 9 illustrates an exemplary diagram showing a switching 
10 manner of images synchronized with a distinctive sound. 

Figs. 10A, 10B, and 10C are diagrams showing switch 
processing of images. 

P 

kU Fig. 11 is a flowchart showing a process, which is taken 

™ when an image quantity n and a music playback time Ts are previously 

<H 15 set. 

In 

jg Fig. 12 is a flowchart showing a process, which is taken 

i H 

when an image playback time Pi and a music playback time Ts are 
Q previously set . 

if] 

i^j Fig. 13 is a flowchart showing a process, which is taken 

l«j 20 when an image playback time Pi and an image quantity n are previously 
|^ set . 

Fig. 14 is a flowchart showing a process, which is taken 
when images, an image playback time, and music, which are to be 
played back, are set by a user. 
25 Fig. 15 is a flowchart showing a process when creating a 

backup-tuned movie. 

Fig. 16 illustrates a diagram showing screen displays from 
A to C displayed on an LCD monitor when creating backup -tuned images . 

Fig. 17 illustrates a diagram showing screen displays from 
30 D to F displayed on an LCD monitor when creating backup - tuned images . 

Fig. 18 illustrates a diagram showing screen displays from 
G to I displayed on an LCD monitorwhen creating backup-tuned images . 

DETAILED DESCRIPTION OF THE INVENTION 
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The invention will now be described based on the preferred 
embodiments, which do not intend to limit the scope of the present 
invention, but exemplify the invention. All of the features and 
the combinations thereof described in the embodiment are not 
5 necessarily essential to the invention. 

Fig . 1 illustrates a diagram showing the exterior of a digital 
camera according to an embodiment of the present invention. Fig. 
1 shows the opposite side of the lens of the digital camera. On 
this side, there are an LCD monitor for displaying images and various 
10 information, a multi- function operations switch for operating the 
camera based on information displayed on the LCD monitor, and a 

S3 

.q speaker for output ting sounds, as well as a power switch and a 

^ finder of the camera. Moreover, a microphone, which is not shown 

m 

ift in the drawings, may record voices. The digital camera displays 

in 

jLr* 15 images on the LCD monitor as well as output ting voices and the 
I/J like from the speaker. 

i ^ 

= f1 Fig. 2 is a structural diagram of the digital camera 10 

13 according to an embodiment of the present invention. The digital 

H camera 10 includes an image capturing section 20 , a voice recording 

20 section 22, a data storing section 30, an image playback section 
40, a movie playback section 50, a music playback section 60, a 
data communications section 70, a setting input section 72, a 
backup-tuned images playback section 80, a backup-tuned movies 
playback section 90, and a backup- tuned images editing section 
25 100. 

The image capturing section 2 0 includes structural and 
electric members needed for photographing and imaging, such as 
a CCD. The digital camera 10 according to the present embodiment 
is capable of photographing images and movies by the image capturing 
30 section 20. 

The data storing section 3 0 records data, such as 
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photographed images. The data storing section 30 writes image 
data in an external storage device, such as a non-volatile memory, 
a volatile memory, or a memory card of the digital camera 10. 

The voice recording section 22 collects voices with a 
microphone and the like. The voice recording section 22 then 
records the collected voices in a memory by superimposing on movie 
data . 

The image playback section 4 0 and the movie playback section 
50 read the image data and the movie data written by the data storing 
section 3 0 from a memory and so forth. The LCD monitor of the 
digital camera 10 then plays back the read image data and the movie 
data . The music playback section 60 outputs music data in a memory 
and voices included in movie data, via a speaker and so forth. 

The digital camera 10 is capable of playing back music 
by the music playback section 60. The music playback section 60 
includes structural and electrical members for playing back music 
and voices . For example, a speaker or headphones may output music 
and sounds . 

The data communications section 70 may transfer recorded 
data to an electronic appliance, such as a personal computer , which 
is outside of the digital camera 10. The data communications 
section 70 includes electrical members necessary for communication 
The data communications section 70 controls, for example, 
conversions of protocols according to communications 
specifications, such as USB, RS-232C, Ethernet, and Bluetooth. 

The backup-tuned images playback section 80 may play back 
voice data, such as music prepared separately from images, as well 
as playing back images. The images that are played back along 
with music, in another words, images accompanied by music, are 
referred to as "backup- tuned images" hereinafter. An example of 
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playing back backup-tuned images is to play back a slide show, 
which sequentially displays images along with playing back music 
as background music that matches with the displaying images. 

On the other hand, the backup-tuned movies playback section 
90 may play back voice data, such as music prepared separately 
from movies, as well as playing back movies. The movies that are 
played back along with music are called backup-tuned movies. An 
example of playing back backup-tuned movies is to play back a 
photographed movie along with playing back music as background 
music . 

The digital camera 10 accepts various settings from the user 
through a setting input section 72 , which includes a multi- function 
switch having a cross key and so forth . The settings to be accepted 
include, for example, a selection of images for playing back, a 
setting of playback time for each image, a selection of movies 
for playing back, a setting of playback time for each movie, a 
selection of music for playing back, a setting of playback time 
for music, and a setting of mixing level for voices. 

The backup-tuned images editing section 100 edits 
backup-tuned images (slide shows) based on the images and music 
as materials . The backup- tuned images editing section 100 adjusts 
the playback time of images and music, which are included in 
backup- tuned images, according to need. The backup- tuned images 
editing section 100 then creates backup-tuned images whose image 
playback time needed for playing back images coincides with a music 
playback time needed for playing back music. In the case of 
backup- tuned movies, the backup- tuned images editing section 100 
creates backup-tuned movies whose movie playback time coincides 
with the music playback time. 

The backup-tuned images editing section 100 may create 
backup-tuned mixed images whose playback time of combination of 
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slide show part of images and movies coincides with the music 
playback time. The details of the backup-tuned images editing 
section 100 are described later. 

Here, the relationship among images , movies, and music, which 
5 are included in backup-tuned images are played back at the digital 
camera 10 according to the present embodiment. 

Fig. 3 is a diagram showing a relationship between the image 
playback time and the music playback time for playing back 
backup- tuned images. With respect to playing back images, each 
10 of the previously selected images (referred to as "image" 

hereinafter) are sequentially played back. In this case, if it 
jjg supposed that Tp represents the image playback time and TS 
j~ represents the music playback time, the calculation of Tp is 
lH undertaken in the following manner. If the number of images that 
jfjlS are sequentially played back is n f Tp is calculated as Tp=Pl+P2+P3 + 
!« "*Pn. Here, Pi(I=l~n) represents an image playback time needed 

?II for playing back each image . On the other hand, the music playback 

hi 

p time is Ts . Since Tp and Ts usually do not coincide with each 
!~J other, the digital camera 10 according to the present embodiment 
20 plays back music along with images by adjusting the image playback 
time Pi, the number of images n, and the music playback time Ts 
by the backup-tuned images editing section 100 so that Tp and Ts 
coincide with each other. Thus, the image playback time of images 
included in backup-tuned images coincides with the music playback 
25 time of music included in backup-tuned images. Therefore, the 
image playback time and the music playback time become the playback 
time of backup-tuned images. 

Fig. 4 is a diagram showing a relationship between the movie 
playback time and the music playback time for playing back 
30 backup-tuned movies. The music and movies played back in 

backup -tuned movies are data separately or originally prepared, 
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respectively. Therefore, since the music playback time usually 
does not coincide with the movie playback time, adjustments of 
the playback time are made by the adjustments of the music playback 
time described above . For playing back movies , the music playback 
5 time Ts of the music played back along with movies is adjusted 
by the backup- tuned images editing section 100 based on a movie 
playback time Tm required for playing back the movies, and the 
music is played back along with the movies. Thus, in the last 
result, the movie playback time of the movies included in the 
10 backup -tuned movies coincides with the music playback time of music 
included in the backup -tuned images, thereby the movie playback 
time and the music playback time become the playback time of the 

[?% backup-tuned movies. 

13 

m 

ji* f Fig. 5 is a diagram showing a relationship between the image 

:fj 15 and movie playback time and the music playback time for playing 

S3 

Iff back backup-tuned mixed images of both still and moving pictures. 

i=x Here, the mixed images are a combination of a slide show part of 

images and movies. The backup- tuned mixed images play back music 
q prepared separately from the mixed images, along with the mixed 

20 images . 

The music that is played in the backup-tuned mixed images 
and the mixed images are data prepared separately from or originally 
to the mixed images . Here, the total playback time including both 
the image playback time and the movie playback time is referred 
25 to as a "mixed image playback time" hereinafter . Therefore, since 
the music playback time and the mixed image playback time do not 
coincide with each other, music is played back along with the mixed 
images after the above-described adjustment of, for example, the 
music playback time and the image playback time are made. 

30 Thus, in the last result, the playback time of the mixed 

images included in the backup-tuned mixed images coincides with 
the playback time of the music included in the backup-tuned mixed 
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images. Therefore, the mixed image playback time and the music 
playback time become the playback time of the backup -tuned mixed 
images. In this case also, a backup-tuned mixed image file may 
also be made in the same way as the backup -tuned images or the 
5 backup-tuned movies. 

Fig. 6 is a diagram showing an exemplary manner of mixing 
voice data and background music for playing back backup- tuned mixed 
images of both still and moving pictures. When playing back 
separately-prepared music data (background music) along with mixed 
10 images, the image playback part in the mixed images plays only 
the background music as a voice. On the other hand, the movie 
;^ playback part in the mixed images plays mixed data of both voice 

IB data included in movies and the background music as a voice. Fig. 

Ill 

'{fk 6 shows the case of playing back both the voice data included in 

^ 15 movies and the background music by mixing them in the proportion 

IB 

If} of six parts to four. 

O 

|f} Fig. 7 is a structural diagram of the backup- tuned images 

j»L editing section 100 . The backup-tuned images editing section 100 

*3 edits backup- tuned images and backup-tuned movies. The 

20 backup-tuned images editing section 100 makes an adjustment of 
the image playback time, the movie playback time, and the music 
playback time according to need. The backup- tuned images editing 
section 100 also heightens anef f ect of the playback of , for example, 
backup- tuned images by setting the timing of switching images, 
25 processing displays of switching images, and processing the 
introductory part and the ending part of playing music. 

The details of each functional structure in Fig. 7 are 
described in the following . The image setting section 110 displays 
on the LCD monitor images stored in a memory and the list of the 
30 images capable of being transferred from a personal computer and 
played back. The user selects images for setting as images from 
among the displayed images. The image playback time-setting 
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section 120 accepts a setting of playback time for each set image. 
The image playback time-obtaining section 130 obtains an image 
playback time by calculating the sum of the playback time of each 
selected image when the selection of images and the image playback 
5 time are made. 

On the other hand, the music setting section 160 displays 
on the LCD monitor the music stored in a memory and the list of 
music capable of transferring from a personal computer and playing 
back. When music is selected, the music playback time-obtaining 
10 section 170 obtains the music playback time of the set music. 

s3 The music genre setting section 162 sets the genre of music 

jn to be played back. The music genre setting section 162 previously 

*~ prepares a music genre, such as classics and rock. The user sets 

W a music genre suited to the atmosphere of the playing images from 

I q 15 among prepared music genres. In this case, the music setting 

^ section 160 may automatically set a random number (title of music) 

!J1 from among the set music genres. Thus, the user can play back 

id 

• ~ music that matches with playing images without setting the title 

I3 of playing music. The user may also select numbers from among 

20 the set music genres . 

The playback time setting section 180 sets the playback time 
of the backup-tuned images as the image playback time or the music 
playback time, which is obtained based on each image playback time, 
after the image , each image playback time , and music are temporarily 
25 set. The user may decide which playback time to set. The user 
may also set the playback time by himself /herself . 

The image playback time -adjusting section 190 makes an 
adjustment of the image playback time according to need. The 
adjustment of the image playback time is made by increasing or 
30 decreasing the number of playing images by the image 

number-adjusting section 200, by increasing or decreasing the 
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playback time of each image, and by increasing or decreasing both 
the number of images and the playback time of each image. 

The music playback time -adjusting section 220 adjusts by 
increasing or decreasing the music playback time according to need. 
5 When shortening the music playback time, cutting of the 

introductory part or the ending part of the music is undertaken. 
When prolonging the music playback time, the music is continuously 
played back or other music is sequentially played. 

The details of functional structures relating to the editing 

10 of backup- tuned movies in Fig. 7 are described in the following. 

P 

IS The movie setting section 140 displays on the LCD monitor 

j?j movies stored in a memory and the list of the movies capable of 

^ being transferred from a personal computer and played back. The 

|f} user selects movies for playing from among the displayed listed 

15 movies. The movie playback time -obtaining section 150 obtains 

if] a movie playback time of the selected movies when the selection 

n - s 

of movies are made. 

« : 

The music setting section 160 sets music and the music 
playback time -obtaining section 170 obtains the music playback 
20 time, in the same way as the backup- tuned images, with respect 
to the music used in backup-tuned movies. 

The playback time setting section 180 sets a playback time 
of backup-tuned movies. There are cases when the movie playback 
time is the basis, when the music playback time is the basis, and 
25 the time set by the user is the basis, for the backup- tuned movie 
playback time. 

The movie playback time -adjusting section 230 adjusts the 
time by increasing or decreasing the movie playback time when the 
movie playback time and the backup- tuned movie playback time do 
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not coincide with each other. For example, when decreasing the 
movie playback time, the required time for cutting is displayed 
to the user. The user cuts the movie parts of the corresponding 
time . 

5 On the other hand, the music playback time -adjusting section 

220 adjusts the time by increasing or decreasing the music playback 
time when the music playback time and the backup-tuned movies 
playback time do not coincide with each other. 

For playing back a voice of backup- tuned movies, the music 
10 processing section 260 mixes the voice included in movie data and 
'j! separately-prepared music . This is the function for playing back 

10 separately-prepared music along with the voice recorded in movies . 

ifi 

m In the mixing, volume adjustments of both the voice in the movies 

^ and music are made in order to play back the voice and music without 

Iff 15 a sense of discomfort. The mixing level setting section 270 

^ undertakes these adjustments. The mixing level setting section 

tH 270 also mixes the voice included in movies in mixed images and 

jjj 

j5 separately-prepared background music. 

13 

a =5l 

The backup-tuned image-editing section 100 may edit 
20 backup-tuned images in order to make the image playback time and 
the music playback time of backup- tuned images, the movie playback 
time and the music playback time of backup- tuned movies, and the 
mixed image playback time and the music playback time of 
backup- tuned mixed images , respectively coincide with each other . 
25 For example, the backup- tuned image-editing section 100 may edit 
backup-tuned images in order to make the difference between the 
image playback time and the music playback time be within a 
predetermined allowable range. The user may designate the 
allowable range of the difference between the image playback time 
30 and the music playback time. 

The above is a description of functional structures for 
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adjusting playback times of backup-tuned images and backup-tuned 
movies . The following description is about functional structures 
for making it possible for users to listen and watch backup-tuned 
images more naturally. 

5 The screen switching-setting section 240 switches images 

in accordance with a specific timing of music . Here, the specific 
timing of music means, for example, timing at the beginning of 
a sub-section of music and at which more than a certain level of 
volume sounds in the music. Figs. 8 and 9 describe this timing 
10 of switching. 

Fig. 8 illustrates an exemplary diagram showing a switching 
manner of images synchronized with sub-sections . A triangle mark 
shows the timing of the beginning of a sub-section of music. A 
circle mark shows the timing of switching images. The timing of 
15 switching images (the circle mark) is set in order to coincide 
with the beginning of a sub-section of music (the triangle mark) . 
Thus, images and music are played back naturally without a sense 
of discomfort since images are played back in a manner that matches 
with the progress of the music. 

20 Fig. 9 illustrates an exemplary diagram showing a switching 

manner of images synchronized with a distinctive sound. A cross 
mark shows the timing of the distinctive sound to sound in music. 
Here , the distinctive sound means the sound of a certain instrument . 
The detection of the distinctive sound is made by retrieving the 

25 distinctive sound from the music based on the playback frequency 
profile that is distinctive to the instrument . A circle mark shows 
the timing of switching images. In this case, the switching of 
images coincides with the timing of the sound of the distinctive 
sound. In Fig. 9, the timing of the circle mark and the cross 

30 mark are the same . 

As an example of switching images in accordance with a 
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distinctive sound, a sound of a drum may be set as the distinctive 
sound. In this case, the user can play back backup- tuned images 
whose images and music are closer matched with each other since 
the images are switched along with the sound of a drum thereby 
5 images may be switched simultaneously to the rhythm of sound. 

When setting the switching of images like this, the number 
of images may sometimes fall short. In this case, the user sets 
images to be played back, by using the image setting section 110 . 
When images are left, the number of remaining images is shown to 
10 the user. The user then deletes the remaining images. 

" l J Ref erring back to Fig . 7, the remaining functional structures 

?y 

13 are described in the following. 

y j 

ill 

!H The image processing section 250 sets a display processing 

in of switching images when sequentially displaying the images. One 

15 of the switching manner of images is, for example, an ordinary 
processing to instantaneously switch the display of an image B 
after displaying an image A. Otherwise, there are "spin door," 
"slide," and "box" as switch processing of images. 
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Figs. 10A, 10B, and 10C are diagrams showing switch 
20 processing of images . The "spin door" is a method whereby a playing 
image rotates and displays the next image after the playing image 
is reversed. The "slide" is a method whereby a playing image moves 
to the right direction as the next playing image gradually appears 
from the left side . The "box" is a method whereby the next playing 
25 image is displayed by gradually increasing in size after appearing 
at the center of a playing image, as a very small image. The user 
may select a desired method of processing amongst the above screen 
switch processing method. 

The switch processing of images is set according to the music 
30 genre to be played back, which is described later. For example, 
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in a case where the music genre is rock music, the user may feel 
a sense of speed by the images being instantly switched. If the 
music genre is classical, images may be smoothly switched in 
accordance witha tune of music by displaying the image B as gradually 
brighteningup (referred toas "f ade-indisplay" hereinafter) after 
finishing the display by gradually darkening the image A (referred 
to as "fade-out display" hereinafter) . 

The music processing section 260 processes for adjusting 
the music playback time in order to make music sound natural . When 
adjusting the music playback time to shorten, it is possible to 
give the user a brusque impression since the music may start or 
end suddenly if the playback time is merely shortened. So, the 
music processing section 260 creates backup-tuned images whose 
image playback time and music playback time coincide with each 
other by fading in and/or fading out the beginning part and/or 
the end part of the music. Thus, the user may listen or watch 
backup-tuned images without a sense of discomfort. 

The backup-tuned images-editing section 100 having the 
above -described structures may adjust playback times for various 
combinations of playback images and playback music. The 
description below is made along with typical examples relating 
to the adjustments of playback times. In the examples below, the 
"image processing" includes the display processing of images , such 
as the "fade-in," the "fade-out," the "spin door" and so forth 
at the image processing section 250 described above. The "music 
processing" includes processing such as the "fade-in" when start ing 
playing back music at the music processing section 260. 

If the number of images n and the music playback time Ts 
are previously set : 

Fig. 11 is a flowchart showing this process. In this case, 
the image setting section 110 sets images to be played back, at 
S10. The image setting section 110 then obtains the set number 
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of images , at S2 0 . Music is set by the user using the music setting 
section 160, at S30. The music playback time-obtaining section 
170 obtains the music playback time, at S40. The number of images 
n and the music playback time Ts are fixed. The image 
5 time-adjusting section 210 automatically sets the image playback 
time for each image in order to coincide the image playback time 
Tp with Ts, at S50.. For example, when Ts is five minutes and 
the number of images n is 10, five minutes is set as the playback 
time, and the image playback time is adjusted so that the image 
10 playback time also becomes five minutes. In this case, the image 
playback time for one image becomes thirty seconds per image, which 
is calculated by dividing the five minutes by ten images. Thus, 
backup- tuned images whose image playback time coincides with the 

^ music playback time are created. Subsequently, the user makes 

w 

j!l 15 an image processing setting of the images included in the created 

1=1 

jjg backup- tuned images at S60 and a music processing setting of music 

i£1 included in the created backup-tuned images at S70 . Finally, the 

q user decides whether or not to create and store the created 

J*j backup-tuned images as a file such as an MPEG file, at S80. Then, 

O20 a necessary file is created according to need, at S90 . 

? 

If the image playback time Pi and the music playback time 
Ts are previously set : 

Fig. 12 is a flowchart showing this process. In this case, 
the image playback time-setting section 120 firstly sets the image 

25 playback time, at S100. The music setting section 160 then sets 
the music, at S102 . The music playback time-obtaining section 
170 obtains the music playback time based on the set music, at 
S110 . The number of images n is calculated by the formula n=Ts/Pi . 
The image setting section 110 randomly retrieves from a memory 

30 and the like, images corresponding to the necessary number, at 
S120. Thus, backup-tuned images whose image playback time and 
music playback time coincide with each other are created. 
Subsequently, the user makes an image processing setting of the 
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images included in the created backup-tuned images at S130 and 
a music processing setting of music included in the created 
backup-tuned images at S140. Finally, the user decides whether 
or not to create and store the created backup-tuned images as a 
5 file such as an MPEG file, at S150 . Then, a necessary file is 
created according to need, at S160. 

If the image playback time Pi and the number of images n 
are previously set : 

Fig. 13 is a flowchart showing this process. In this case, 
10 the image setting section firstly sets the playback time for each 
image, at S170 . The image playback time-setting section 120 then 
;~ sets the playback time for each image, at S180. Then, the image 

*G playback time is uniquely decided. What is necessary is music 

if] 

111 to play back. The image playback time Tp is calculated by the 

m 

:;J 15 formula Tp=Pi*n. The music setting section 160 automatically 
Ifj selects from a memory and the like, music whose music playback 

3 

j=% time is close to the image playback time, at S190. However, it 

i 

Ul is rare to find music having the music playback time Ts that coincides 

J3 with the image playback time Tp. So, the music playback 

:^20 time -adjusting section 220 makes the music playback time Ts of 
the set music coincide with the image playback time Tp, at S200. 
For example, if Ts is longer than Tp, Ts and Tp are coincided by 
cutting the beginning part and/or the end part of the music. 
Subsequently, the user makes an image processing setting of the 
25 images included in the created backup- tuned images at S210 and 
a music processing setting of music included in the created 
backup-tuned images at S220. Finally, the user decides whether 
or not to create and store the created backup-tuned images as a 
file such as an MPEG file, at S230. Then, a necessary file is 
30 created according to need, at S240. 

If there is only music data of Ts<Tp whose music playback 
time is close to the image playback time, Pi or n may be slightly 
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adjusted. 

If the images, the image playback time, and music, which 
are to be played back, are set by the user: 

Fig. 14 is a flowchart showing this process. In this case, 
5 it can finally be divided into three cases. The first case is 
a case that the playback time is decided by the user 7 s designation. 
In this case, the image playback time and the music playback time 
are coincided with the designated playback time. The second case 
is a case that the music playback time Ts is adjusted based on 
10 the image playback time Tp. In this case, the music playback time 
is coincided with the image playback time. The third case is a 

n 

.IJ case that the image playback time Tp is adjusted based on the music 

*<2 playback time Ts . In this case, the image playback time is 

i £j 

if] coincided with the music playback time. 

m 

in 15 These three cases are described according to the flowchart . 

i 

IH The user firstly sets images for playing back using the image 

3 S J 

p setting section 110, at S250. The image playback time-setting 

P section 120 sets the playback time for each image, at S260. The 

image playback time-obtaining section 130 obtains the image 

20 playback time based on the set image playback time, at S262. The 
music setting section 160 sets music to be played back, at S270. 
The music playback time-obtaining section 170 obtains the music 
playback time based on the set music, at S272. Then, the 
adjustments of the image playback time Tp and the music playback 

25 time Ts begin. First, whether the playback time is designated 
by the user is judged, at S280. If the time is designated (the 
first case) , the imageplayback time is adjusted inorder to coincide 
with the designated playback time (T) , at S290. Since the number 
of images are already decided, the image playback time Pi is 

30 calculated by the formula Pi=T/n. On the other hand, the music 
playback time Ts is adjusted in order to coincide with the playback 
time. If this function is used when the user wants to set the 
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playback time to a predetermined time, backup- tuned images that 
are adjusted to a desired playback time may be easily played back. 

If the playback time is not originally designated by the 
user, whether or not to make the image playback time of the 
5 backup-tuned images be based on the image playback time is decided, 
at S3 10 . If the image playback time is set as the basis (the second 
case) , the music playback time Ts is adjusted based on the image 
playback time Tp. The music playback time Ts is adjusted in order 
to coincide with the image playback time Tp, at S320. Thus, the 
10 user may play back music suited to the image playback time if the 
user only decides images, music, and the image playback time for 

If playing back. 

y 

5^ At S3 10, if the image playback time is not set as a basis, 

H the music playback time becomes the basis . In this case (the third 

JL! 

n 15 case) , the image playback time Tp is adjusted based on the music 
« playback time Ts . The image playback time Pi is adjusted according 

fl to Ts, at S330. That is, Pi is calculated by the formula Pi=Ts/n. 

This calculation is convenient when the user wants to make the 
^ image playback time coincide with music that the user wants to 

20 play back. 

Subsequently, the user makes an image processing setting 
of the images included in the created backup-tuned images at S340 
and a music processing setting of music included in the created 
backup-tuned images at S350. Finally, the user decides whether 
25 or not to create and store the created backup-tuned images as a 
file such as an MPEG file, at S360. Then, a necessary file is 
created according to need, at S370. 

Although the processing of images and music is made after 
the adjustment of the playback time in the above typical examples, 
30 these processings may be undertaken before the adjustment of the 
playback time. 
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On the other hand, typical examples in a case of creating 
backup- tuned images are described in the following. Fig. 15 is 
a flowchart showing a process when creating a backup-tuned movie. 
First, the user sets movies using the movie setting section 140, 
at S400. The user then sets music using the music setting section 
160, at S410. The playback time setting section 180 sets a basis 
value of the playback time of the backup-tuned movies, at S420. 
Then, whether or not the backup-tuned movies are within the 
designated time is judged, at S430. If the playback time is 
designated by the user, the movie playback time-adjusting section 
23 0 adjusts the movie playback time in order to coincide with the 
set playback time as well as adjusting the music playback time 
in order to coincide with the set playback time by the music playback 
time -adjusting section 220. 

On the other hand, if the playback time is not designated 
by the user, whether or not to set the playback time as the movie 
playback time is judged, at S460. If the movie playback time is 
set as the playback time, the music playback time -adjusting section 
220 adjusts in order to make the music playback time coincide with 
the movie playback time, at S470. 

If the playback time is not set as the movie playback time, 
the playback time is set as the music playback time. The movie 
playback time - ad j ust ing sec t ion 2 3 0 then ad j us t s the movie playback 
time in order to coincide with the music playback time, at S480. 

Subsequently, the user makes a music processing setting of 
music included in backup-tuned movies at S500. Here, processing 
such as mixing of voices included in the movie data and music as 
background music , and the fade-in and fade-out processing of music , 
are undertaken according to need. The music processing may be 
undertaken before the adjustment of the playback time. 

Finally, the user decides whether or not to create and store 
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the created backup- tuned images as a file such as an MPEG file, 
at S510 . Then, a necessary file is created according to need, 
at S520. 

The backup-tuned images whose image playback time coincides 
5 with the music playback time and the backup-tuned movies whose 
movie playback time coincides with the music playback time, which 
are created in the manner described above, may be stored in a memory 
as a movie file of MPEG format as well as transferring to a personal 
computer and playing back on the computer. 

10 Figs. 16 to 18 illustrate diagrams showing screen displays 

^3 displayed on an LCD monitor when creating backup-tuned images. 

!D Figs . 16 to 18 follow the order of displaying display screens shown 

i~ to the user when the backup-tuned images editing section 100 edits 

If backup-tuned images. 

m 
m 

* 15 First, the user inputs desired settings using the 

: : 

|n multi- function operations switch, according to the menu displayed 

I = ! 

!:? on the LCD monitor. At the menu selection page A, the user selects 

Q the "create backup-tuned images." Then, the user selects the 

"select images" at the image/music selection page B. Then, at 
20 the image selection page C, the list of the images stored in a 

memory and the like is displayed on the LCD monitor. The user 

selects images that he/she wants to play back. In this case, the 

user selects images 1, 6, 7, and 8. 

Then, the display screen goes on to Fig. 17. At the image 
25 playback order-setting page D, the user sets the order of playing 
back images. For the playback order, there are the order of the 
photographed date and time, the random order , and the user ' s manual 
setting, whereby the user may freely change the order. In this 
example, the user selects the "photographed order." Then, at the 
30 playback time-setting page E, the user sets the playback time of 
images. In this example, the user sets the image playback time 
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as five seconds. At the music selection page F, the user selects 
music to be played back along with the selected images. The page 
F may display several pieces of retrieved music having a close 
playback time to the image playback time. Here, the user selects 
5 the " song3 . wav . " 

After selecting images and music, the page moves to Fig. 
18 . The playback time basis-designating page G displays scheduled 
playback time for the respective selected images and music. The 
user then selects a playback time to be the basis. Here, the user 
10 selects the "image playback time." Then, the music playback time 
is adjusted by, for example, cutting the end part of the music, 
*2 according to the selected time. At the page H, the images and 
13 music are set processing for heightening an image display effect 
!i* and a music playback effect. Regarding the images, such as the 
?- n 15 "fade-in" for displaying images by gradually lightening up the 
ffj images and the "spin door" for switching images are set . Regarding 
the music, such as the "fade-in" for playing music by gradually 

111 turning up the volume is set . Thus, backup- tuned images are simply 

i ' 

j« createdby the above-described process . After all of the settings, 
;^20 the user decides whether or not to store the created backup- tuned 
images in an MPEG file and the like, at the data-storing page I. 

The user also decides whether to store data such as the type 
of the images, the playback order, the image playback time, and 
the method of processing images, which have been selected so far, 
25 as a creation procedure file . By storing this data as the creation 
procedure file, the later editing will be simple as well as making 
it possible to create a slide show. 

By using the digital camera with a music playback function 
described above, the user may easily create and enjoy backup- tuned 
30 images whose playback times of images and music coincide with each 
other without a sense of discomfort and whose timing of such as 
switching images is matched with the music. Moreover, a similar 
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creation may be done for backup- tuned movies and backup- tuned mixed 
images . In the case of the backup- tuned movies and the backup- tuned 
mixed images, the mixing data of voices may be added to the above 
creation procedure file. 

As is obvious from the description above, according to the 
present invention, a digital camera with a music playback function, 
which plays back images and music by coinciding the image playback 
time required for sequentially displaying images with the music 
playback time, can be provided. Therefore, a user may easily create 
and enjoy backup- tuned images whose playback times of images and 
music coincide with each other without a sense of discomfort and 
whose timing of such as switching images is matched up to the music . 

Although the present invention has been described by way 
of exemplary embodiments, it should be understood that those 
skilled in the art might make many changes and substitutions without 
departing from the spirit and the scope of the present invention 
which is defined only by the appended claims. 
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